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Abstract. We study a general transition operator, 
generated by a random walk on a graph X; in partic- 
ular we give necessary and sufficient condition on the 
matrix coefficient (1-step transition probablilities) to 
be a bounded operator from 1°°{X) into itself. More- 
over we characterize compact operators and we relate 
this property to the behaviour of the associated ran- 
dom walk. We give a necessary and sufficient condi- 
tion for the pre-adjoint of the discrete Laplace oper- 
ator to be an injective map. 
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1. Introduction 

In this paper we consider the transition operator P associated with a general irre- 
ducible Markov chain {Z^jneN defined on a probability space (X, O, P) with a state space 
X which is finite or countable. It is well known that one of the consequences of the time- 
independence property of Markov chains is that P[Zn+i = y\Zn = x] is independent of n, 
hence the transition operator P is uniquely determined (according to equation (2)) by the 
coefficients {p{x,y)}j:^y^x (called 1-step transition probabilities defined by 

p{x,y):=F[Zi=y\Zo = x]. (1) 



This map gives rise to an amount of interesting concepts (such as harmonic and su- 
perharmonic functions, stationary measures and so on) which allow us to get information 
about the behaviour of the Markov chains. Take for instance the characterization of re- 
current random walk in terms of non-negative super harmonic functions (see Theorem 1.16 
of [1] or Theorem 5.3 of [2]) or in terms of excessive measures (see [1] Theorem 1.18). 
Other applications may be found in the study of the asymptotic behaviour of the n-step 
transition probabilities ]?'^"')(x, y) (see for instance [3]). 

One of the most interesting topics is given by the discrete harmonic analysis on graphs 
(see [4] and [5]) and the corresponding Dirichlet problem (see for instance [1], Chapter 4). 
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More recently we started to study mean value properties for finite variation measures 
on graphs (see [6]) with respect to suitable families of harmonic functions; in that paper it 
is shown how these properties are related with the range of the preadjoint of the discrete 
Laplace operator (see Section 3). These are some of the reasons which justify the present 
paper. For those who are not familiar with some terminology we suggest to look at [7] for 
functional analysis reference and at [1] for random walk theory reference. 

We begin (Section 2) dealing with "generalized" transition operator (with more gen- 
eral kernels p{x,y)) defined by the equation (2): we give a complete characterization 
of continuous transition maps (Theorem 2.1) and of compact transition maps with non- 
ncgativc kernel (Theorem 2.2); moreover wc show that compactness implies recurrence 
(Proposition 2.3), meanwhile the converse it is not true (Example 2.4). 

In Section 3 we consider the stochastic kernel defined by equation (1) and we deal with 
the corresponding (stochastic) transition operator which is a continuous map from 1°°{X) 
into itself. We construct the preadjoint of the discrete analogous of the Laplace operator 
and we turn our attention to its null space and its range. In particular we give a necessary 
and sufficient condition for this operator to be an injective map (Theorem 3.2); this result 
generalizes Theorem 1.18 of [1]. We finally make some remarks about the topological 
properties of its range. 

We fix now the basic notation: let $ represent the real field M or the complex field C 
and p:XxX-^<I>bea function. We consider the domain D and the linear operator P 
depending by p as follows 



The properties of the linear map P are strictly related to the functional space where 
it is restricted: for instance if the coefficients p satisfy equation (1) (which is equivalent 
to p{x, y) > for all x,y E X and ^ygx^'l*^' v) — ^ every x e X) then the transition 
operator P is called stochastic; in this case it is easy to show that P is a bounded linear 
map from l°°(X,iJ,) into itself (for any real or complex measure on X) and ||P|| = 1; 
furthermore given any excessive, positive measure i/ on X (see Section 3), any stochastic 
map P is bounded, with ||P|| < 1, from LP{X, u) into itself {p E [1, +00)). 

If P is generated by a reversible random walk (see for instance [8], Paragraph 2. A) 
and if u is the reversibility measure then P is a linear, bounded, selfadjoint operator from 
L^(X, z/) into itself, satisfying ||P||L2(x,iy) = p{P)j where p(P) is the spectral radius of 
the random walk {X, P) (see [1] Chapter 1, Paragraph B). More precisely it is possible to 
show that an operator K defined as in eq. (2) with kernel k{x,y) (instead of p{x,y)) is 
selfadjoint if and only if i'{x)k{x, y) = v{y)k{y, x) for all x,y & X. 





Y.P^''^y)f^y)^ V/ei?(P), VxeX. 
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2. Compactness of the transition operator 



In this section we give a necessary and sufficient condition for the general linear map P 
(defined by eq. (2)) to be a bounded map from from into itself. Then we characterize 

all the maps with non- negative kernels which are compact; in the case of stochastic maps, 
this conditions is related to the recurrence property. The interest in the space 1°°{X) will 
be justified in the next section. We start with boundeness conditions. 

Theorem 2.1. Let P the transition operator defined by eq. (2) (where p{x,y) are 
real (complex) numbers for any x,y & X); then the following assertions are equivalent: 

(i) P is a continuous linear operator from 1°°{X) into itself; 

(ii) sup^^x J2yex \Pi^^ y)\<oo. 

(Hi) D{P) D 1^{X) and P{l^{X)) C 1^{X). 

If one of the previous condition holds, then \\P\\ = sup^.^^^ S^ex \p{^j y)\- 

Proof. Let us discuss the complex case. Since X is at most countable, we may suppose 
X — {xi}i^j, where J C N has the same cardinality of X . If X is finite then the theorem 
is trivial, we suppose that X is countable (and J = N). Let x e X and define 



f^{xi) := < I if p{x,Xi) = 0, i < n, 

.0 if i > n. 

then ||/"||oo = 1 for every n e N and for every x E X. 

(i) =^ (ii). We easily note that, G D{P) for every n e N,x e X and ||-P/^||oo > 
\{Pf^){x)\ = X^j<„ \p{x,Xi)\, then if n tends to infinity and P is bounded, we have 

yex ieN 

and the arbritrary choice of x leads to the conclusion. 

(ii) =^ (i). If a :— supj.^x Syex \p{^jy)\ < then for every / e 1°°{X) we obtain 

WPfWoo = sup \{Pf){x)\ < sup V \p{x,y)\ 



xex xex 



using the last equation and eq. (3) we obtain that D{P) D 1°°{X), P(Z°°(X)) C 1°°{X) 
and a — \\P\\- 

(ill) =^ (ii). Let us note that /°°(X) C D{P) implies that for every / e 1^{X) 
and for every a; e X we have X^yex 2^)1 ^ which is equivalent to the 

condition {p{x,y)}y£x £ ^^(-^) for every x e X. Let Xx G 1°°{X)* defined by Xx{f) '= 
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'EyexPi^^y)fiy)^ then ||Aa;||i^(x)* = ^y^x \pi^^y)\- Now the condition P{l°°{X)) C 
implies sup^g^ < +00, for every / G 1°°{X), then, using the principle of 

Uniform Boimdeness, we have sup^.^^;^ ||'^a;||z<^(x)« < +00 which is equivalent to (ii). 
(i) (iii). It is trivial. 

□ 



We turned our attention now to the compactness property for a transition operator 
with non negative kernel. 

Theorem 2.2. Let X a countable graph and let us choose an enumeration {xi} for 
X . Let P a transition operator on X with non negative elements, satisfying the condition 
^^Pxex l^yex Pi-'^^ y) ^ Then P is a bounded, linear operator from into itself; 

moreover P is compact if and only if 

lim sup > p{x,Xi) — 0. (4) 

i>n 

The last condition is independent from the chosen enumeration. 

Proof. Theorem 2.1 implies the boundedness of P. If P is compact, then, for every bounded 
sequence {fi} in {Pfi} is relatively compact, hence there exists a subsequence {nj} 

such that {Pfn-} is a Cauchy sequence. Let fn{xi) equal to 1 if i > n and otherwise, 
then 

Wn)(-) = E^'(-'^0 

i>n 

and if m > n, since p{x, y) > for every x,y & X, 

m 

\\Pfn - PfmWoo = sup Pi^^^i)- 

By the Cauchy property, for every £ > there exists je such that for all j2 > ji > je we 
have 

sup y p{x, Xi) < e/2; 
xex . ^-^.^ 

we note that, for every fixed x E X , m l^iLn+iPi-^^-^i) (resp. n >—>■ YliLn+iPi-^^ -^i)) 
not decreasing (resp. not increasing), hence 



sup E p{x,Xi) < e/2 < e, 



«^e^i=n. +1 



which implies limn^+00 sup^.^^ Zli>n^'(^' ^0 = 0- 

Vice versa if we consider the finite range (compact) projections on 1°°{X) defined by 

Viif){xn) := 




for all i e N, then {PVif){x) = J2i<nPi^^^i)fi^i)- By Theorem 2.1 ||P - PVi\\ = 
sup^gj^ YliynPi-^^-^i) then — PVi|| tends to if n tends to infinity. By Theorem 4.18(f) 
of Rudin [9], PVi is compact for every i e N, hence P is compact since Theorem 4.18(c) 
of Rudin [9] holds. 

The condition (4) does not depend on the choice of the enumeration, since compactness 
is defined "a priori" . □ 

We note that the previous theorem says that P is compact if and only if for any £ > 
there exists a finite subset G X such that sup^^j^ "^yeA^ P^^^ v) ^ ^' ^^^^ means, for 
instance, that a necessary condition for the compactness property is that \imy^oop{x, y) = 
holds uniformly with respect to a; e X (where the limit is taken in the Alexandroff 
compactification of X with the discrete topology). 

We immediately note that if X is locally finite, then P is not compact. In fact in this 
case, for every n e N, ^^<„ deg^Xi) < +cxd; this means that there exists ni > n such that 
Xi is not a neighbour of x^ for any i < n, hence '^i^nPi^'ni^ ^i) — 1 ^q. (4) cannot 
be satisfied. Moreover one can show that if P is compact then it is a recurrent transition 
operator. 

Proposition 2.3. Let X be a graph and P a random walk on X which is a compact, 
transition operator from 1°°{X) into itself; then P is recurrent. 

Proof. Let A := {xq, xi, . . . , Xn} and Zn the Markov chain associated to P; when P is 
compact then, by Theorem 2.2, if a; e X 

¥[Zm ^ A\Zo = x]=J2 ^[Zm-i = y\zQ = x]p{y,Xi) = 

= ^ P[^m-i = y\zo = x] ^piy,Xi) < 

y€X i>n 



< ^ P[Zm-l = y\zo = x] sup ^p{w,Xi) < sup ^p{w,Xi) Q 
vex '"^^i>n '"^^i>n 

If B := {3k e N; Zn ^ A, \/n > k} = U^eN (~^n>k {Zn ^ A} it is clear that 



F{B) <J2n^n>k{Zn ^ A}), 

but nn>k{Zn ^ A} <Z {Zm ^ A} for every m > k which implies F{nn>k{Zn ^ A}) = 
and ¥{B) = 0. Thus by Woess [2] Theorem 3.5, P is recurrent. □ 

The necessary condition given in the previous proposition is not sufficient; it is not 
difficult to find random walks which are recurrent and the associated transition operator 
is not compact. 
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Example 2.4. Let us give an example of random walk giving rise to a compact 
transition operator. To this aim we consider any sequence of real number such 
that po = 1 and Pi e (0, 1] for every i > 1. Let us take X = N and 

{Px if a; e N and y ~ x + 1 

1-Px if y = and x 
otherwise. 

The condition (4) is easily equivalent to lim^^+ooPn = 0; moreover, using Theorem 3.11 of 
[2] , it is not difficult to show that (X, P) is recurrent (resp. positive recurrent) if and only 
if lim„^+oo nr=o ^'^ ^ (resp. Y,^=o]Xi=QPi < +oo). This proves that {X,P) positive 
recurrent (and hence {X, P) recurrent) does not imply the compactness of the transition 
operator P. 

3. The null space of the pre-adjoint of the Laplace operator and finite varia- 
tion stationary measures. 

The discrete analogous of the Laplace operator is given by (P — loo) : 1°°{X) l°°(X) 
where l^o id the identity operator on 1^{X). It is straightforward to show that the 
preadjoint map {P — loo)* is given by {Q — li) : 1^{X) —>■ 1^{X) where 

{Qv){y) := p{x, y)i^{x), Vy e X, 

and ill is the identity map on 1^{X); from now on, if A : D — * F is a map, we denote by 
Rg(A) the image (or range) of D through A (that is A{D)). A bounded function is said 
to be harmonic if is an element of the null space of the discrete laplacian (we denote the 
set of all bounded harmonic functions by Tl°°{X,P)). 

In [6] it was shown that a finite variation measure u onX (i.e. u G 1^{X)) has the weak 
mean value property with respect to o E X (that is, '^^^x fi^)^i-^) — fi^) "l^xex ^i^)^ 
for every / e 7f°°(X, P)) if and only if {u — 5o ^xex ^(^)) ^ ^&{Q ~ ^i) (where 5o is the 
(finite variation) Dirac measure with support in {o}. /,From this point of view, it is 
important to know when Q — li is injective and when it has a closed range. In this section 
we give a complete answer to the first question and we make some remarks related to the 
second. 

To this aim, we characterize in particular all the stationary measures with finite vari- 
ation. We recall that a signed measure is called stationary (resp. excessive) if 

{Qu){y) = u{y), Vy G X (resp. {Qu){y) < u{y), Vy G X) 

provided that {Qu){y) exists for every y e X. We note that a finite variation measure u is 
stationary if and only if G ker(Q — li). 

Lemma 3.1. Let v be a signed stationary measure on X, then —\v\ is a negative 
excessive measure which is stationary if and only if v =\v\ or v = — 
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Proof. It is well know that if / is a complex integrable function on a measure space (Y, jj) 
then 



and the equality holds if and only if there exists a e [0, 27r) such that / = |/| exp(zQ;) /U-a.e. 
If we consider the measure space X with the counting measure and fy{x) :— u{x)p{x,y) 
then by hypothesis fy e L^{X) for every y E X and 



W\{y) = Hy)\ 



u{x)p{x,y) 



x€X 



< 



\u\{x)p{x,y) = {Q\u\){y) 



x€X 



and the equality holds if and only if i'{x)p{x, y) = \v\{x)p{x., y) exp(iQ:) (where a G {o, tt}, 
since fy is a real function) which leads to the conclusion. □ 



We are ready to prove the following theorem which characterizes all the stationary 
measures (i.e. the null space of Q — Ii)- Before state the Theorem we recall that for any 
irreducible random walk it is possible to define a natural number called the period of the 
random walk (see [8], Section 5. A). 

Theorem 3.2. Let (X, P) he an irreducible random walk, then there exists a finite 
variation, stationary measure v ^ if and only if {X, P) is positive recurrent. In this case 
there exists a e R \ {a} such that v = afi where jj. satisfies 

li{y) = limsupp<^"''+-'~*)(a;,|/)/(i 

n— »oo 

(the right hand side is seen to he independent of x and d is the period of the random walk). 

Proof. If we suppose that there exists a stationary measure u with finite variation and 
Co, Ci, . . . , Cd_i, Cd = Co is the partition of X given by the periodicity classes, then, by 
Lemma 3.1, — is an excessive measure; Lemmas 2.4, 2.5 and Theorem 2.2 of Woess [2] 
and Tonelli-Fubini's Theorem imply 

lH(c,+i) Yl Hy)\< E E i^(^)i^^(^'2/) = 

= E E H^)\pi^^y) 

x&Ci y€Ci+i 

then \u\{Co) < HiCi) <■■■< \u\{Cd-i) < W\{Cd) = H{Co), hence = \u\{X)/d 

for every z = 0, 1, . . . , (i — 1. 

Using the "Renewal Theorem" by Erdos-Feller-PoUard (see [10] or Theorems 3.6 and 
3.7 of [2]) and Lebesgue bounded convergence Theorem, 

W\{y) < E W\{x)p^'"'Hx,y)''^°°d-i,{y) Y IH(^); (5) 

x£Ci x^Ci 
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since v ^ then there exists i and y & Ci such that ji^Kj/) > 0, thus eq. (5) imphes that 
f^{y) > 0, hence {X, P) is positive recurrent. 

On the other hand, if (X, P) is positive recurrent, Theorem 3.9 of Woess [2] imphes 
that is a stationary, probability measure. 

If v is another stationary, finite variation measure on X {u ^ 0) then by eq. (5), 
W\{y) < W\{^)l^iy)'^ if we suppose, by contradiction, that there exist y & X such that 
\i^\{y) < li^KX) fj,{y) , then we have 

i=EIH(2/)/IHW<EM2/) = i 

yex yex 

which is a contradiction; hence |z/|(-)/|z/|(X) = /u(-). If we define ^{y) := i/{y)/\u\{X) then 
\v\ = jjb and (2// — z7)/(2|u(X) —V{X)) is a stationary, probability measure. By Theorem 3.9 
of Woess [2], (2// — z7)/(2//(X) — V{X)) = jj, which is equivalent to 17 = V{X)ii, that is, 
V = v{X)ii. □ 

As a consequence of this Theorem we obtain that the bounded, linear map Q — Hi is 
injective if and only if (X, P) is not positive recurrent. 

We try now to answer to the second question: when Rg((5 — li) is closed? 

By Schauder's Theorem (see Brezis [7] Theorem VI. 4), since P = Q*, we have that 
the operator Q from 1^{X) into itself, is compact if and only if eq. (4) holds. Now it is well 
known (see for instance [11], Theorem 4.23) that if Q is compact operator from a Banach 
space into itself then Q — 1 has closed range. Hence if equation (4) holds we have that a 
finite variation measure v on X has the weak mean value property with respect to o e X 

if and only if - So J2x€X ^(^)) ^ ^siQ - ^i)- 

This is obviously only a partial answer to our question; a way to reach a complete a 
satisfactory answer, which we don't undertake here is given by the following remarks. 

We recall that if {Z, \\ ■ \\z), {Y, \\ ■ \\y) are Banach spaces, D is a, linear subspace of Z 
and ^ : D — > y is a linear map such that swp^^D.^^^^^^^i \\Ax\\y ='■ P, then there exists a 
unique bounded, linear map A : D ^ Y which extends A; moreover A is bounded by the 
same constant /? and inf = _inf ||^a;||r- Therefore, if ^ : D — > y is 

xeD:\\x\\z = l xeD:\\x\\z = l 

a linear and injective map, then 

sup = V inf \\Ax\\y 

yeRg{A):\\y\\Y = l x€D:\\x\\ z=l 

(where, by definition, 1/0 := +oo). 

Now using the Open Mapping Theorem it is simple to show that if ^4 : Z — > y is a 
linear, bounded, injective map then 

Rg(^) = Ri(l) ^ inf \\Ax\\y > 0. 

xeD:\\x\\z = l 

In our case, if the Markov chain is not positive recurrent, then Rg{Q — li) is closed 
if and only if inf ||Qz^ — > 0. 
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